Toward Better Training in Peer Assessment: Does Calibration Help?
نویسندگان
چکیده
For peer assessments to be helpful, student reviewers need to submit reviews of good quality. This requires certain training or guidance from teaching staff, lest reviewers read each other’s work uncritically, and assign good scores but offer few suggestions. One approach to improving the review quality is calibration. Calibration refers to comparing students’ individual reviews to a standard—usually a review done by teaching staff on the same reviewed artifact. In this paper, we categorize two modes of calibration for peer assessment and discuss our experience with both of them in a pilot study with Expertiza system.
منابع مشابه
Integrating Portfolio-Assessment into the Writing Process: Does it Affect a Significant Change in Iranian EFL Undergraduates’ Writing Achievement? A Mixed-Methods Study
The paradigm shift from testing the outcome to assessing the learning of process shines a light on the alternative assessment approaches, among which portfolio-assessment has sparked researchers’ interest in writing instruction. This study aimed at investigating the effect of portfolio-assessment on Iranian EFL students’ writing achievement through the process-centered approach to writi...
متن کاملExplaining the characteristics of peer-to-peer learning: A qualitative study
Explaining the characteristics of peer-to-peer learning: A qualitative study Introduction: Learning through peers is an educational method. Explaining the characteristics of learning with the help of peers has not been done in a study, so the purpose of this study was to explain the characteristics of learning with the help of peers. Materials and Methods: This qualitative study was perfo...
متن کاملPeer Assessment in evaluation of Medical sciences students
Introduction: Recently, peer assessment is especially noticed as a progress evaluation method. Although it is a known method, it is a novel method in many countries that they use traditional methods. Then the topic of current review article is peer assessment in medical education. Methods: The documents related to peer assessment, advantages, disadvantages, applications and how use it extracte...
متن کاملEffects of A Peer Assessment System based on a Grid-based Knowledge Classification Approach on Computer Skills Training
In this study, a peer assessment system using the grid-based knowledge classification approach was developed to improve students’ performance during computer skills training. To evaluate the effectiveness of the proposed approach, an experiment was conducted in a computer skills certification course. The participants were divided into three groups: one that learned with traditional instruction,...
متن کاملThe Role of Initial Input in Reputation Systems to Generate Accurate Aggregated Grades from Peer Assessment
High-quality peer assessment has many benefits. It can not only offer students a chance to learn from their peers but also help teaching staff to decide on grades of student work. There are many ways to do quality control for educational peer review, such as a calibration process, a reputation system, etc. Previous research has shown that reputation systems can help to produce more accurate agg...
متن کامل